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1. INTRODUCTION 


The space industry has developed many composite materials that have been designed to 
have high durability in proportion to their weights. Many of these materials have a likelihood for 
flaws that is higher than in traditional metals. There are also material coverings (such as paint) 
that develop flaws that may adversely affect the performance of the system in which they are 
used. Therefore, there is a need to monitor the soundness of composite structures. To meet this 
monitoring need, many nondestructive evaluation (NDE) systems have been developed. An NDE 
system is designed to detect material flaws and make flaw measurements without destroying the 
inspected item. Also, the detection operation is expected to be performed in a rapid manner in a 
field or production environment. 

Within the last few years, several video-based optical NDE methodologies have been 
introduced. Some of the most recent of these methodologies are shearography, holography, 
thermography, and video image correlation. A detailed description of these may be found in Chu 
et al. (1985), Hung (1982), and Russell and Sutton (1989). 

This research focuses on a performance evaluation of shearography equipment. Users of 
this equipment realize that performance is a function of a set of control variables as well as a set 
of noise variables. However, there is a shortage of research that characterizes this relationship in 
model form. Hence, this project has four major objectives: 

(1) Identify the control and noise variables that are most likely to influence 
shearography performance. 

(2) Define a model that connects equipment output to control and noise variables. 

(3) Determine the control and noise variables and their interactions that have significant 
influence on shearograph performance. 

(4) Identify the setting for control variables that will optimize equipment performance. 
At this setting, compute a probability of detection (POD) curve. 

Due to the necessary shortness of this research period, objective (1) is achieved through 
engineering judgment. The remainder of this paper addresses objectives (2) through (4). 

In the following discussion, y is considered to be an output from an NDE inspection 
system. Output y is assumed to be a random variable with some probability distribution. Depend- 
ing on the system, y is either continuous (eddy current is an example) or binary (shearography is 
an example). Berens and Hovey (1984) described an a-hat analysis method for a continuous y 
and a hit/miss methodology for systems that produce binary output. For completeness, this report 
discusses a setup where the continuous y is expressed as a function of control and noise vari- 
ables. A similar setup is discussed for binary y along with a prescription for achieving the above- 
mentioned objectives. 


2. CONTINUOUS OUTPUT VARIABLE 

Assume that y is the continuous output of an NDE inspection system with a normal 
probability distribution of mean fi. Further assume that control variables x\, xj, .... x* and 
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noncontrollable noise variables zu zi, .... z m have an influence on output y. For compactness, let 

control vector X = fa, x 2 x k )' and noise vector Z = fa, z 2 , z m Y . A general equation that 

connects output y to X and Z is 

y = Po + X'P + Z'£+X'AZ + e , (2.1) 

where p is a general parameter of vector coefficients of control variables, $ is a coefficient vector 
of noise variables, A is a matrix which contains the coefficients of the interactions between noise 
and control variables, and £ is a random lack of fit component 

Model (2.1) generates two response surfaces that are of benefit to NDE performance 
evaluation. They are system output mean which is given by 

E[y] = H = p o + %'P > ( 2 . 2 ) 


and system output variance 

Var[y] = < 7 2 = [P+X'A] V [S+X'A]' , (2.3) 

where V is the variance-covariance matrix for noise variables in Z Observed data on y, X., and Z 
may be used to estimate parameter values fo, P, & and A. Prior observations on z (perhaps field 
data) are used to estimate V. Once parameters are estimated, hypotheses tests may be performed 
to determine if control and/or noise variables have an influence on NDE performance. In particu- 
lar, NDE evaluators are interested in variable interactions. 

The reader may recognize components of the Taguchi methodology in this presentation. 
Actually, model (2.1) remedies some of the shortcomings in the Taguchi method. In fact, unlike 
Taguchi, model (2.1) provides for interaction analysis and allows a complete analysis of output 
behavior with respect to changes in control variables. Myers et al. (1992) give a description of 
model (2.1) and details its connection to the Taguchi method. In this paper, we apply model (2.1) 
to the evaluation of NDE equipment performance. 

Application Examp le 

To illustrate the usefulness of model (2.1) to NDE performance evaluation, we use an 
example constructed by Myers et al. (1992). For our case, we pretend that there are two control 
(*i, * 2 ) and two noise (zi, z 2 ) variables for which (2.1), (2.2), and (2.3) become (2.1)', (2.2)', and 
(2.3)', respectively. 


Y - Po + x lPl + x lPl + ^lZi + S 2 z 2 + ^ll-*lZi + A \ 2 X X Z 2 
+ X 2l x 2 z 1 + \ 22 x 2 z 2 + £ 


(2.1)' 


E\Y] - Pq + x 1P1 + x 2 p 2 , 


( 2 . 2 )' 
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(2.3)' 


In (2.2)' and (2.3)', A = 


Var (£) = a 2 


A n A 12 
A 2 i A 2 2 


, J1 = (PuPiY, £ = (5i, 52)', var(£) = V = 


of 0 

0 of 


, and 


For the variables used to construct (2.1)' through (2.3)', if a statistical analysis shows that 
P 2 = 0 while all other parameters in (2.1)' are nonzero, then (2.2)' and (2.3)' show that an 
adjustment on control variable xi affects Var[F] and has no effect on mean E[Y). Additional 
comments about this situation appear in the data analysis section. 

3. BINARY OUTPUT VARIABLE 


In many NDE systems, the output is 1 or 0 where 1 represents a flaw detection and 0 
denotes a nondetection. This output variable y is said to be binary or hit/miss. For each single 
flaw inspection, it is assumed that p is the probability of flaw detection and thus y has a Bernoulli 
probability mass function /(y) = py(\-p)y~ x . The mean of y is given by 


E\y]=p = p. (3.1) 

It is desirable to devise a setup for output y that is similar to (2.1). One difficulty, among 
many, is that the variance Var(y) = p(l-p) which is not constant over flaw size and model (2.1) 
requires a constant variance. However, the difficulties posed by the binary nature of y are reme- 
died by using (3.1) to express mean p (i.e., p) as a function of control variables X and noise vari- 
ables Z- Such a remedy is offered by Beren and Hovey (1984) where they express p as a function 
of one variable (crack size). They also listed seven candidate relationships between crack size 
and probability of detection. Of their seven, this research uses their recommendation that the 
logistic relationship best describes the connection between p and crack size a. This research is 
also the first that we could find where p is expressed as a function of control vector X. and noise 
vector Z for NDE equipment. 

For variables a and p, as defined above, the logistic relationship is 


P ~ 1+,?A> + Aa ’ 


where Po, Pi are constants. A transformation of (3.2) gives 

ln = Po+P i a • 


(3.2) 


(3.3) 
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performance even with the low cell counts provided we used an alternative to the full six- 
factorial design. Thus, we chose to analyze the collected data by using a two-factorial experiment 
to analyze each combination in the set of all possible two-variable subset combinations. The 
analysis is repeated for all possible three-variable subset combinations. Each analysis included a 
test of significance of at most two-variable interactions and a test for main affects. Of all the 
possible two- variable and three-variable analyses. Table 1 shows what variables showed at least 
one single significant main affect (row 1) or was involved in at least one significant interaction 
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